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OO I Abstract. We write down the generalized Bessel function associated with the root system of 



type D by means of multivariate hypergeometric series. Our hint comes from the particular 
case of the Brownian motion in the Weyl chamber of type D. 
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■ 1 Root systems and related processes 

1^ ■ We refer the reader to [11] for facts on root systems. Let {V, (•)) be an Euclidean space of finite 

. dimension m > 1. A reduced root system i? is a finite set of non zero vectors in V such that 



1) i? n Ma = {a, -a} for all a £ R, 

2) aa{R) = R, 

where cTq is the reflection with respect to the hyperplane Ha orthogonal to a 



> 

o 

in ■ , . 

O: cTaix) = X - xeV. 

{a, a) 



00 ! A simple system S* is a basis of span(i?) which induces a total ordering in R. A root a is positive 

■ if it is a positive linear combination of elements of S. The set of positive roots is called a positive 

'i> . subsystem and is denoted by The (finite) reflection group W is the group generated by all 

^ , the reflections ctq, for a £ R. Given a root system R with positive and simple systems S, 

^ ' define the positive Weyl chamber C by: 



C := {x G (a, x) > V a G R+} = {x£V, (a, x) > V a G S} 

and C, dC its closure and boundary respectively. One of the most important properties is 
that the convex cone C is a fundamental domain, that is, each A G ^ is conjugate to one and 
only one /.f G C. Processes related to root systems have been of great interest during the last 
decade and notably the so-called Dunkl process [17]. This y- valued process was deeply studied 
in a sequence of papers by Gallardo and Yor O [6l O |8] and Chybiryakov and its projection 
on the Weyl chamber gives rise to a diffusion known as the M^-invariant or radial Dunkl process. 
The generator of the latter process acts on C^(C) as 

^fen(x) = ^An(x) + ^ k{a) 



*This paper is a contribution to the Special Issue on Dunkl Operators and Related Topics. The full collection 
is available at |http:/ /www.emis.de/journals/SIGMA/DunkLoperators.html| 
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with (a,Vii(a;)) = whenever {a,x) = 0, where A: is a positive function defined on the orbits 
of the VF-action on V and is constant on each orbit. Such a function is called a multiplicity 
function. The semi group density (with respect to the Lebesgue measure on V) of the radial 
Dunkl process is written as [17j 



for x,y € C, where 

The kernel is defined by 

Dk'{x,y) = X Dk{x,wy) 

w<^W 

where is the non symmetric Dunkl kernel J8|, and is up to the constant factor the 
so-called generalized Bessel function since it reduces to the (normalized) Bessel function in the 
rank-one case Bi [T5]. It was identified in [T] with a multivariate hypergeometric series for both 
root systems of types A and B. Since the C-type root system is nothing but the dual root 
system of B, it remains to write down this kernel for the root system of type D which is the 
remaining infinite family of irreducible root systems associated with Weyl groups. This was 
behind our motivation to write the present paper and our main result is stated as 

Theorem 1. For the D-type root system, the generalized Bessel function writes 

-I /i22\ /i22\ 

where qFi^^^^^ is the multivariate hypergeometric series of Jack parameter 1/ki, x := (xf , . . . , 
x^), k = ki > is the value of the multiplicity function and q := 1 + (m — l)ki. 

Our strategy is easily explained as follows: according to Grabiner [9l p. 21], the Brownian 
motion in the Weyl Chamber is a radial Dunkl process of multiplicity function k = 1, that is 
k{a) = 1 for all a £ R. Indeed, it is shown in [T^] that the radial Dunkl process, say , is the 
unique strong solution of 



where S is a m-dimensional Brownian motion and k{a) > for all a (z R. Hence, by Grabiner 's 
result on Brownian motions started at C and killed when they first reach dC together with the 
Doob's transform [16] applied with the harmonic function [9l p. 19] 

Hy) ■= n 

aeR+ 

the semi group density the Brownian motion in the Weyl chamber is given by 

plix,y) = ^y2 det{w)Nt,m{wy-x), (2) 
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where A^^^^ is the m-dimensional heat kernel given by 

Ntm{x) = - — ^^e"!""!'/^*, \x\'^ = (x,x), x € V. 

On the one hand and for the irreducible root systems A, B, D, the sum over in ([2]) was ex- 
pressed in [9] as determinants. On the other hand, the generalized Bessel function was expressed 
for A and -B-types root systems via multivariate hypergeometric series of two arguments and of 
Jack parameter which equals the inverse of one of the multiplicity values (see the end of [1]). 
When this parameter equals one, the multivariate series takes a determinantal form [TU] which 
agrees with Grabiner's result. As a matter of fact, we will start from the expression obtained 
in [9] for the Brownian motion in the Weyl chamber of type D then express it as a multivariate 
series of a Jack parameter 1. Once we did, we will generalize the result to an arbitrary positive 
Jack parameter using an analytical tool known as the shift principle. Before proceeding, we 
shall recall some facts on multivariate hypergeometric series and investigate the cases of A and 
-B-types root systems. 



2 Mutlivariate series and determinantal representations 

We refer the reader to [H [2l [12] and references therein for facts on Jack polynomials and multi- 
variate hypergeometric series. Let r be a partition of length m, that is a sequence of positive 
integers ri > • • • > Tm- Let a > 0, then the Jack polynomial Cr"^ of Jack parameter a is the 
unique (up to a normalization) symmetric homogeneous eigenfunction of the operator 

1=1 1=1 ■> 

corresponding to the eigenvalue 

m 

Pt = ^T^Tj - {2/a){i - 1)] + \T\{m - 1), |t| = n H h Tm- 

1=1 

The normalization we adopt here is 

(xi + --- + x„r = Ec(-)(x), n>0, 

T 

where the sum is taken over all the partitions of weight |t| = n and length m. For a = 2 
it reduces to the zonal polynomial [15] while for a = 1 it fits the Schur polynomial [H]. Let 
p,q GN, then the multivariate hypergeometric series of two arguments is defined by 

n=0|r|=n^ ^^^ ^ "^'^ Cr ' {1)\t\1 

where (1) = (1, . . . , 1) and for a partition r 



(#=n(°4('-')) =n 

i=l ^ ^ i=l 



U")=TT/._i^-_n^ ^T-r r(a-(.-l)/a + T,0 

Via - (i-\)la) 



is the generalized Pochhammer symbol and L is the Gamma function. We assume of course that 
the above expression makes sense for all the coefficients (aj)i<j<p, (&j)i<j<(j- An interesting 
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feature of the hypergeometric series of Jack parameter a = 1 is that they are expressed through 
univariate hypergeometric functions [13] as follows [TU] 



4 = 1 



-pr (r(/Lii + l))™ -pi" T{m + (l)j) det [p=^g((/i4 + l)i<i<p, (1 + 0j)i<j<g; 

fj r(m + /xO (r(0, + 1))- V{x)V{y) ^ 

for all ^i,4>j > — where V stands for the Vandermonde polynomial and empty product are 
equal 1. For instance, when p = q = 0, we have 

, . det(e^'^O^.^i 
V{x)V{y) 



and for p = 0, q = 1, we similarly get 

m 

(1) m(m — 1) -| — |- 

oF-[ ^(m + X, y) = vr 2^ I I ("^ — 1)' 



(1) '^O^-D fV, r(m + <^) det [0=^1(1 + ,/.;xiyj)]I"j=i 

^'/m-l-Wi-'ri/l='77- 5!r> ll/m — 111 ^ 1^ 

(r(0+l))™ V{x)V{y) 



i=l 

for 6 > —1. 



3 Brownian motions in Weyl chambers: types A and B revisited 

Brownian motions in Weyl chambers were deeply studied in [9] and they are shown to be h- 
transforms in Doob's sense of m independent real BMs killed when they first hit dC. They are 
then interpreted as m independent particles constrained to stay in the Weyl chamber C. The 
proofs of those properties use probabilistic arguments. Here, we show how, for both types A 
and B, these properties follow from the above determinantal representation of multivariate 
hypergeometric functions of two arguments. Let us first recall that the ^-type root system is 
defined by 

Am-i = {±(ej - Cj), l<i<j< m}, 

with positive and simple systems given by 

R+ = {ei - ej, 1 <i < j < m}, 5 = {e, - e^+i, 1 < i < m - 1}, 

where {ei)i<i<m is the standard basis of M™, W being the permutation group. In this case, 
V = R™, the span of R is the hyperplane of M™" consisting of vectors whose coordinates sum to 
zero and C = {x € M™, xi > ■ ■ ■ > Xm}- Besides, there is only one orbit so that k{a) := ki > 
and the function h (product of the positive roots) is given by the Vandermonde polynomial. 

Next, it was shown in [1] that is given up to the constant by oFQ^^''^\x,y) (we 

use another normalization than the one used in [T] so that the factor \/2 is removed). Thus, 
when ki = 1, ^ writes for R = Am~i 

P]{x,y) = ^det(iV,(y, -x,))™=i, (3) 
where Nt is the heat kernel, namely 
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Thus, the ^-transform property is easily seen. A similar result holds for R = Bm- This root 
system has the following data 

R = {zbcj, zbcj ± Cj, 1 < i < j < m}, = {cj, 1 < i < m, ± e^, I < i < j < m}, 

S = {ei - ei+i, 1 < i < m, em}. C = {y G M"", yi > ^2 > • • • > ym > 0}. 

is generated by transpositions and sign changes (xj i— > — Xj) and there are two orbits so that 
k = (ko, ki) thereby 7 = mkQ + m(m — l)ki. The generalized Bessel functioE0 is given by [H 
p. 214] 

-^D^{x, y) = oFi'/'^^ (ko + {m- l)k, + ^ 



\w\ ' V 2' 2 ' 2 

It follows that 

-{\^?+\y?)/^t ^ 



n 

,2^ 



where h{y) = V{y ) Y\ yi and C{m) is a constant depending on m. Taking /cq = 1 and using 
the identity [13] 



for some constant C, one gets for the Brownian motion in the S-type Weyl chamber 

P't\^, y) = ^ det my^ - X,) - Nt{y, + . (4) 

The /i-transform property is then obvious. 

4 Generalized Bessel function of type D 

The root system of type D is defined by [HI p. 42] 

R = {±ej ± Cj, 1 < i < j < m}, i?+ = {cj ± ej, 1 < i < j < m}, 

and there is one orbit so that k{a) = ki thereby 7 = m{m — l)ki. The Weyl chamber is given 
by: 

C = {xe M."\ xi> X2> ■■■ > \x.m\} = Ci U SmCi, 

where Ci is the Weyl chamber of type B and Sm stands for the reflection with respect to the 
vector Cm acting by sign change on the variable Xm- Now, Grabiner's result reads in this case 

y(y2) det[iVt(y, - xj) - Ntiyi + x,)]^,=i + det[Nt{yi - x,) + Nt{y, + x,-)]^,=i 

= 2 

Cm ^-(|^|2+|^|2)/2t ^^* [sinh(x^yj/t)]^^.^^ + det [cosh(x^yj/t)];;^^.^^ ^^^^^^^ 



'^There is an erroneous sign in one of the arguments in [I]. Moreover, to recover this expression in the Bm case 
from that given in [1], one should make substitutions o = fco — 1/2, fci = 1/q, q = 1 + (m — l)fci. 



6 



N. Demni 



where 7 = 171(171 — 1). With the help of the determinantal representations and of [13] 
0^1 (1^) = ^sinh(2Vi), 0=^1 Q,^) =cosh(2V^), 



one gets 



-(|x|2+|s/|2)/2t 



.1=1 



77.(1) / _ , 1 y- \ ^ ^(1) 



1 



With regard to ([T]) and setting q := \ + (m — it is natural to prove the claim of Theorem[TJ 

Proof. It uses the so-called shift principle that we briefly outline [3]. Let be a conjugacy 
class of roots of R under the action W. Let A;^; be the value of the multiplicity function on this 
class. Then, the generalized Bessel function associated with the multiplicity function k' defined 
by 



k'{a) 



k{a) + 1 if a G 
k{a) otherwise, 



is given by 
1 



\W\ 



Dk{x,wy) 



PE{x)pE{y) 



Pe{x) ■■= {a,x) 

aeR+nE 



where ^e{w) is defined hy pe{wx) = iE{w)pE{x) and C is some constant. Since we will deal with 
both the B and D-types, it is convenient to add a superscript B or D to each corresponding item. 
Therefore, W^, denote the Weyl groups associated with the root systems of types B, D 
respectively and k^ , k^ denote the corresponding multiplicity functions. Recall that [11] is 
the semi-direct product of 5m and (Z/2Z)'" (sign changes) while is the semi-direct product 
of Sm and (Z/2Z)'"~^ (even sign changes). Let E := {ej, 1 < i < m}, then pe{x) is invariant 
under permutations and even sign changes and skew-invariant under odd sign changes (note 
that -D^^ is not M^^-invariant). It follows that ^e{w) = 1 for w G while S,e{w) = — 1 for 
w G \ W^. Now, recall that k^ takes only one value while k^ takes two values. Since the 
Dunkl Laplacian of B reduces to when the value of the multiplicity function ko on E is 
zero [18] , the (non-symmetric) Dunkl kernel associated with R = Dm is given by the Dunkl 
kernel Dj^ associated with R = B^ when k^ = 0. In fact, this is true since Dk is the solution 
of a spectral problem which is independent of W. As a result. 



\WD\' 



il + CEH)D, 



B,ko=0, 



x,wy) 



1 j^WB{ko=0) ^ PE{x)pE{y) j^wB{kQ=l) 



+ 



C\WB\ 



-D 



where we used the shift principle to derive the last line. Keeping in mind that 



1 



{x,y) 



(i/fci 



feo + (m-l)fei + i,|^,| 



and using that \W^\ = 2\W^\ [Uj p. 44] we are done with C = 2^ 



tD 
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5 Concluding remarks 

As the reader can see, is not equal to specialized with /cq = and this shows that 

the generalized Bessel function is intimately related to W. Moreover the symmetrical of -D^° 
with respect to Sm gives in the special case ko = which reflects the fact that the Weyl 

chamber of type D is the union of the one of type B and its symmetrical with respect to Sm- 
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